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ASYMPTOTIC EXPANSION FOR DISTRIBUTION OF 
MARKOVIAN RANDOM MOTION 

ANATOLY A. POGORUI 



Abstract. In this paper we study an asymptotic expansion for the distribu- 
jrt ■ tion of a random motion of a particle driven by a Markov process in diffusion 

approximation. We show that the singularly perturbed equation of a Markov- 
ian random motion can be reduced to the regularly perturbed equation for the 
distribution of the random motion. 



1. Introduction 



The first CLT for additive functionals of a Markov chain with noncovmtable 
phase space was proved by Doeblin [T]. Additional functionals of Markov and 
semi-Markov processes with finite phase space have intensively been studied by 
V.S.Korolyuk, A.F.Turbin, M.Pinsky, VM.Shurenkov and others @],[5],[6]. 

In 1951 S. Goldstein introduced the telegrapher's stochastic process in his seminal 

paper [2J, which is a random motion driven by a homogeneous Poisson process. 

This basic telegrapher process has been extended by M.Kac in [3] . Goldstein-Kac's 

telegraph process on the line, and its weak convergence to the one-dimensional 

OQ | Brownian motion is well-known. 

This paper deals with the n-dimensional random motion which is an additional 
functional of some Markov process. This kind of models is well known and popular 



in the physical literature for the description of the long polymer molecules. For 



example, one of the forms of the Airing model in [7] is similar to the model in this 
paper. 

Let us consider the random motion of a particle in W 1 driven by a Markov process 
£(£), which sojourn times at states are exponential distributed with rate A > and 
transition probabilities pij — 2 J-i %i hj G 2? = {1, 2, . . . , 2n}, where E is the 



phase space of £(£) 
03 



Let bi,...,b n be a Cartesian basis of M. n . Put e*i = b\, e-2 = — b\, e$ — 62, 
e 4 = -62, •••, ein-i = b n , e 2n = —b n and Vi — ve^ i = 1, 2, . . . , 2n, where v > is 
constant speed of the particle. 

We assume that the particle moves in n-dimensional space in the following man- 
ner: If at some instant t the particle has velocity Vi, then at a renewal moment 
of the Markov process the particle takes a new velocity Vj, j ^ i with probabil- 
ity p^ = 2 n-i ■ The particle continues its motion with velocity Vj until the next 
renewal moment of the Markov process, and so on. 

Let us denote by f(t) = (xi(t),X2{t), ■ . ■ ,X n (t)), t > the particle position at 
time t. Consider the function 
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c(i) = (c 1 (i),c 2 (i),...,c n (i)) = v i , 

i e E. 

Then the position of the particle at time t can be expressed as 

f(t) = f(0) + ( C(at))dt. 
Jo 

2. Equation for probability density of particle position 

Let us consider the bivariate stochastic process <;(£) = {r(i),£(t)) with the phase 
space M. n x E. It is well known that this process is Markovian and the generating 
operator of <;{€) is of the following form 4 , 8 : 

Aip(f, i) = d{i)<p'(r, i) + X[Pip{f, i) - f{r, i)], (1) 

where 

6{i)y'{r,i) = C x {i)— V {r,i) + C 2 {i)—^,i) + ... + C n (i)—y>(f, i), 

and P(p(r,i) = ^j E ¥>(**>*)■ 
jeE\i 
Now, let us consider the density function 

JiyC, X\ 7 ... , XjijUXi . . . uX n — 

= P{x\ < a?i(f) < £i + dxi, . . . ,x n < x n (i) < x„ + <&£„} 

n 

It is easily verified that /(£, xi, . . . , a; n ) = E /i(^) a^i ,--■-. £«) is the probability 

i=l 

density of the particle position in R™ at time t. 



Lemma 1. The function f satisfies the following differential equation 

n" r d , d 2n\ , „ 



2n\ ^¥r r d , xW 9 2nA 






2n 

fc=i >=i 

Proof. For i £ E function /$ satisfies the first Kolmogorov equation, namely 

(yfi(t, X\, . . . , a; n j . . . . . 
57 = Afi{t,Xi,...,x n ), i£E (2) 

with initial conditions /,(0, x\, . . . ,x n ) = f\ . 
Eq.Q can be written in more detail as follows 

Oji\t, Xi, . . . , X n ) i _. w O , . . 
7- h (-1) V — fi{t,Xl,...,X n ) +Xfi{t,Xl,...,X n )- 

— - J2 fi{t,xi,...,x n )=0, iEE. (3) 

Now, put f(t,xi,...,x n ) = {fi(t,Xi,...,x n ),i £ E}. The set of equations (3) 
can be written in the following form 

W = o, 
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where L 2n = {Uj}ij&E, hi = J^ + ("l^afr + \ kj = 2^1 > * ^ 3- 
The function / satisfies the following equation [9] 

det(L 2n )/ = 0, (4) 

n 

with the initial condition /(0, Xi, . . . , x n ) = J2 ft ■ 

k=l 

The determinant of matrix Li n is well known and it has the form 

'" d , _• d 2n\ 



*«(^)=n<s+<- i >Sr+^>+ 



1=1 



dt dxi In — 1 



2n\ vA rr,9 „ ,,■ d 2n\ , 

^rrEn^ + Mr^ + ^^T 1 

fe=l «=1 
Mfc 



D 



<g^7 and —v-S— appear in L<2n symmetrically it is easy to see that all 
monomials of the polynomial det(L 2 n) contain v k only with even powers k > 0. 

3. Reduction of singularly perturbed evolution equation to 
regularly perturbed equation 

Let us put v = e" 1 and A = £~ 2 , where e > is a small parameter. It is well 
known [8] , [10] , [11] that the solution of Eq.Q in hydrodynamical limit (as e — > 0) 
weakly converges to the corresponding functional of Wiener process. 

By using technique developed in [T3] , we can find asymptotic expansion of the 
solution of Eq.(|3]), which consists of regular and singular terms. This technique 
involves tedious calculations [4].|10j. 

Proposition. The equation det(L2n)/ — is regular perturbed, that is, multi- 
plying it by e in ~ 2 , we get 

where D e = e 2 D\ +e 4 Z?2 + ..., Di, i — 1,2, ... , are respective differential operators. 

Proof. To avoid cumbersome expressions, we consider the case when n — 3. Let us 
put x = x\, y = xi, z = x%. In this case Eq.@ has the following form 

— V r- (-l) % v-Q-fi(t,x,y,z) + Xfi{t,x,y,z) - - ^2fi(t,x,y,z), (5) 

jE-B 

i = l,...,6. 

Putting v = e^ 1 and A = e~ 2 , we obtain the following singularly perturbed 
system of equations 

dMt '£ y ' Z K (-l) i e- 1 ^f i (t,x,y,z) + e- 2 f i (t,x,y,z)- 

! ^/i(t,a:,I/,z) = 0, (6) 



e- 2 - 



i = 1, . . . ,n. 
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Let us consider the equation det(L 6 )/ — 0, where f(t,x,y,z) — Yl /itA^i^ 2 )- 

It is easy to see that elements of matrix Lq = (hj)i,j£E are as follows: la = 
§- t + (-!)*«& + A and l l3 = |, for i ± j, i,j e {1, 2, . . .', 6}. 



Hence, the equation det(Le)f = has the following form 



, , T ^n, x r 7776 ln d 

det(L 6mt , X ,y, Z ) = {—e-"- 



432 (_&_ 

625 V dx 2 



dy 2 



-e 



432 
125 £ 

1296 
125 £ 



d 2 \ d 



dx 2 dy 2 dz 2 J dt 
d?_ 24 _ 8 / d 4 



144 
5 2 



a 2 



d 2 



dz 2 
d 2 \ d 



dx 2 dy 2 dz 2 ) dt 2 

d 2 



72 _ 4 d 4 
dt 2 25 \dx 2 dy 2 dy 2 dz 2 dx 2 dz 2 ) 5 dt 4 



4e" 



<9 : 



6e~ 



dx 2 dy 2 dz 2 J dt 3 



2e" 



d 4 



d 2 



d 2 



d 



dx 2 dy 2 dy 2 dz 2 dx 2 dz 2 J dt 



d 2 



dx 2 dy 2 dy 2 dz 2 dx 2 dz 2 J dt 2 



d 2 



d 6 



— e 



2 



d 2 



d 2 \ d 



dx 2 dy 2 dz 2 J dt 4 



difi 



432 _ fi d 3 . ,, 
-25-e- w }f(t,x,y,z 



dx 2 dy 2 dz 2 
0, 



with the initial condition f(0,x,y,z) = fa. 
Multiplying Eq.([7]) by e 10 , we obtain 



,d 5 A 2 25 

%-l8 A + e T 



& 



1 . d 



dt 2 3 dt 54 



+ 



(7) 



+£ c 



125 
~L8~ 

: 625 
216 



9^ 

9^3 



1 A d 2 

-A 



3 dt 2 216 



a 4 5 A d 3 



, 3125 
1296 



<% 5 6 <9i 4 



5 A (2) 9 



dt 



l A m*L 



18 <% 3 72 dt 2 
10 3125 <9 6 



7776 at 6 



}/ = 0, 



where A = ■¥- + S- + ^- A< 2 ) = d " + a " 

dx 2 dy 2 dz 2 ' dx 2 dy 2 dy 2 dz 2 



a 1 

dx 2 dz 2 



(8) 



□ 



Lemma 2. 77ie solution of equation Q) wii/i i/ie initial condition f(0,x,y,z) = 
uq(0, x, y, z) + e 2 ui(0, x, y, z) + e 4 U2(0, x, y, z) + . . ., has asymptotic expansion 

f(t,x,y,z) = u Q (t,x,y, z) + e 2 u 1 (t,x,y,z) + e 4 u 2 (t,x,y, z) + ..., (9) 

where the principal term Ua(t, X, y, z) represents the solution of equation 

d 5 

— u Q (t, x, y, z) = — Au (t, x, y, z). 
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Proof. To find the asymptotic expansion of the solution of (|HJ| we use the method 

proposed in [13] and developed in [4j . In conformity with this method the solution 

of ([5]) can be expanded into the series ©, where e > is small. 

Substituting ((9|) into ([8]), we get the following equations for computing of Ui, 

i > 

d 5 

—u (t,x,y,z) = —Au (t,x,y,z); 

d . . 5 . . 

—ui(t,x,y,z) = — Aui(t,aj,j/,«)+ 
OT 18 



,25 



A 1 A {2 > 

dt 2 3 dt 54 



u (t,a;,y,^); 



a_ 
9* 



u 2 (t,x,y,z) = — Au 2 (t,a;,2/,z)+ 



18 



,25 
~6~ 



r a 2 i a 5 A f21 

A 1 A 1 - J 

9i 2 3 dt 54 



125 
18" 



a 3 1 A a 2 5 A l2) d 

A 1 A (2) — 

dt 3 3 dt 2 216 at 



ui(*,;e,2/,z)+ 

u (t,x,y,z); 



d 5 

—u m+5 (t,x,y,z) = —Au m+5 (t,x,y,z)+ 



25 



A 1 A (2) 

dt 2 3 dt 54 



125 
18~ 

625 
216 



9 3 1 A d 2 5 Am 3 

A 1 A (2) — 

dt 3 3 dt 2 216 St 



u m+i (t,x,y, z)+ 
u m+3 (t,x,y,z)- 



t) 3 



2 



" -^A— + — A& — 

at 4 18 dt 3 72 at 2 



u m +2(t,x,y,z)- 



3125 
1296 

for m > 0. 



a 5 



at 5 6 



- 1a< 2 ) 



at 4 



u m+1 (t,x,y, z) + 



3125 a 6 

7776 at^ 



u m (t,x,y,z) = 0, 



□ 



Let us consider the function 
ifc) 



/£ '(t,x,y,z) = u (t,x,y,z) + e ui(t,x,y,z) + ... +s u k (t,x,y,z). 

In |10j for the solution of a singularly perturbed equation of type §3§ the remain- 
der of asymptotic expansion in the circuit of diffusion approximation was studied. 
Taking into account that f(t,x,y,z) — ~}2 fi(t,x,y,z), it follows from the esti- 

mate of the reminder in [4] , [12] that 

\\f(t,x,y,z)-fV(t,x,y,z)\\=0(e 2k ) 
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4. Conclusions 



Singularly perturbed equations of type ([3]) in hydrodynamical limit (where -£? = 
0(1), A 4 0) have become the subject of a great deal of researches [5] . [4] . [B] . [TU] . [TT] 
and others. By using the technique of professor A.F.Turbin [9], we reduce singu- 
larly perturbed system of equations ([3]) to Eq.(j4]), which turns out to be regularly 
perturbed in hydrodynamical limit to diffusion process. 

Therefore, in such cases we may simplify cumbersome calculations of terms of 
asymptotic expansion for solution of singulary perturbed equations for functionals 
of Markovian random motion. 

Acknowledgements I wish to thank an anonymous referee for careful reading 
of the paper and insightful comments and remarks. 
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